Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation

نویسندگان

چکیده

Object detection is an important computer vision technique that has increasingly attracted the attention of researchers in recent years. The literature to date field introduced a range object models. However, these models have largely been English-language-based, and there only limited number published studies addressed how can be implemented for Arabic language. As far as we are aware, generation text-to-speech engine utter objects’ names their positions images help Arabic-speaking visually impaired people not investigated previously. Therefore, this study, propose segmentation model based on Mask R-CNN algorithm capable identifying locating different objects images, then uttering Arabic. proposed was trained Pascal VOC 2007 2012 datasets evaluated testing set. We believe one few uses train test model. performance compared with previous literature, results demonstrated its superiority ability achieve accuracy 83.9%. Moreover, experiments were conducted evaluate incorporated translator TTS engines, showed could effective helping understand content digital images.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep Learning Autoencoder Approach for Handwritten Arabic Digits Recognition

This paper presents a new unsupervised learning approach with stacked autoencoder (SAE) for Arabic handwritten digits categorization. Recently, Arabic handwritten digits recognition has been an important area due to its applications in several fields. This work is focusing on the recognition part of handwritten Arabic digits recognition that face several challenges, including the unlimited vari...

متن کامل

SmartEyes : An Object Identification System for the Visually Impaired

The dawning of the computer era has opened a world of new possibilities and solutions to solving the many challenges faced by the visually impaired in their quest for autonomous living. According to researcher Yasser Ebrahim the visually impaired faces two principal challenges when interacting with their environment. One of which is to sense and identify the objects surrounding them. This is co...

متن کامل

the use of appropriate madm model for ranking the vendors of mci equipments using fuzzy approach

abstract nowadays, the science of decision making has been paid to more attention due to the complexity of the problems of suppliers selection. as known, one of the efficient tools in economic and human resources development is the extension of communication networks in developing countries. so, the proper selection of suppliers of tc equipments is of concern very much. in this study, a ...

15 صفحه اول

Computer Vision-based Object Recognition for the Visually Impaired Using Visual Tags

Recognizing generic objects in the surrounding environment is a major challenge for the visually impaired for which few assistive technological solutions have been devised to date. Nevertheless, in recent years, several computer vision-based strategies have emerged for this task which utilize visual tags affixed to objects for identification. These approaches are distinguished by their reliance...

متن کامل

DEEP-SEE: Joint Object Detection, Tracking and Recognition with Application to Visually Impaired Navigational Assistance

In this paper, we introduce the so-called DEEP-SEE framework that jointly exploits computer vision algorithms and deep convolutional neural networks (CNNs) to detect, track and recognize in real time objects encountered during navigation in the outdoor environment. A first feature concerns an object detection technique designed to localize both static and dynamic objects without any a priori kn...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Electronics

سال: 2023

ISSN: ['2079-9292']

DOI: https://doi.org/10.3390/electronics12030541